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THE APPLICATION IDENTIFIED ABOVE HAS BEEN EXAMINED AND IS ALLOWED FOR ISSUANCE AS A PATENT. 
PROSECUTION fJN IHE MERITS IS CLOSED . THIS NOTICE OF ALLOWANCE IS NOT A GRANT OF PATENT RIGHTS. 
THIS APPLICATION IS SUBJECT TO WITHDRAWAL FROM ISSUE AT THE INITIATIVE OF THE OFFICE OR UPON 
PETITION BY THE APPLICANT. SEE 37 CFR 1.313 AND MPEP 1308. 

THE ISSUE FEE AND PUBLICATION FEE (IF REQUIRED) MUST BE PAID WITHIN THREE MONTHS FROM THE 
MAILING DATE OF THIS NOTICE OR THIS APPLICATION SHALL BE REGARDED AS ABANDONED. THIS 
STATUTORY PERWP CANNOT BE EXTENDED . SEE 35 U.S.C. 151. THE ISSUE FEE DUE INDICATED ABOVE 
REFLECTS A CREDIT FOR ANY PREVIOUSLY PAID ISSUE FEE APPLIED IN THIS APPLICATION. THE PTOL-85B (OR 
AN EQUIVALENT) MUST BE RETURNED WITHIN THIS PERIOD EVEN IF NO FEE IS DUE OR THE APPLICATION WILL 
BE REGARDED AS ABANDONED. 



HOW TO REPLY TO THIS NOTICE: 

I. Review the SMALL ENTITY status shown above. 

If the SMALL ENTITY is shown as YES, verify your current 
SMALL ENTITY status: 

A. If the status is the same, pay the TOTAL FEE(S) DUE shown 
above. 

B. If the status is changed, pay the PUBLICATION FEE (if 
required) and twice the amount of the ISSUE FEE shown above 
and notify the United States Patent and Trademark Office of the 
change in status, or 



If the SMALL ENTITY is shown as NO: 

A. Pay TOTAL FEE(S) DUE shown above, or 

B. If applicant claimed SMALL ENTITY status before, or is now 
claiming SMALL ENTITY status, check the box below and enclose 
the PUBLICATION FEE and 1/2 the ISSUE FEE shown above. 

□ Applicant claims SMALL ENTITY status. 
See 37 CFR 1.27. 



II. PART B - FEE(S) TRANSMITTAL should be completed and returned to the United States Patent and Trademark Office (USPTO) with 
your ISSUE FEE and PUBLICATION FEE (if required). Even if the fee(s) have already been paid, Part B - Fee(s) Transmittal should be 
completed and returned. If you are charging the fee(s) to your deposit account, section Mb" of Part B - Fee(s) Transmittal should be 
completed and an extra copy of the form should be submitted. 

III. All communications regarding this application must give the application number. Please direct all communications prior to issuance to 
Mail Stop ISSUE FEE unless advised to the contrary. 

IMPORTANT REMINDER: Utility patents issuing on applications filed on or after Dec. 12, 1980 may require payment of 
maintenance fees. It is patentee's responsibility to ensure timely payment of maintenance fees when due. 
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PART B - FEE(S) TRANSMITTAL 



Complete and send this form, together with applicable fee(s), to: Mail 



or Fax 



Mail Stop ISSUE FEE 
Commissioner for Patents 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
(703) 746-4000 



INSTRUCTIONS: This form should be used for transmitting the ISSUE FEE and PUBLICATION FEE (if required). Blocks 1 through 4 should be completed where 
appropriate. All further correspondence including the Patent, advance orders and notification of maintenance fees will be mailed to the current correspondence address as 
indicated unless corrected below or directed otherwise in Block 1 , by (a) specifying a new correspondence address; and/or (b) indicating a separate "FEE ADDRESS" for 
maintenance fee notifications. 



CURRENT CORRESPONDENCE ADDRESS (Note: Legibly mark-up with any corrections or use Block I) 



7590 



10/09/2003 



SCULLY SCOTT MURPHY & PRESSER 
400 Garden City Plaza 
Garden City, NY 11530 



Note: A certificate of mailing can only be used for domestic mailings of the 
Fee(s) Transmittal. This certificate cannot be used for any other accompanying 
papers. Each additional paper, such as an assignment or formal drawing, must 
nave its own certificate of mailing or transmission. 

Certificate of Mailing or Transmission 

I hereby certify that this Feefs) Transmittal is being deposited with the United 
States Postal Service with sufficient postage for first class mail in an envelope 
addressed to the Mail Stop ISSUE FEE address above, or being facsimile 
transmitted to the USPTO, on the date indicated below. 
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(Date) 
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01/09/2004 



EXAMINER 



ART UNIT 



CLASS-SUBCLASS 
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382-287000 



1 . Change of correspondence address or indication of "Fee Address" (37 
CFR 1.363). 

□ Change of correspondence address (or Change of Correspondence 
Address form PTO/SB/122) attached. 

□ "Fee Address" indication (or "Fee Address" Indication form 
PTO/SB/47; Rev 03-02 or more recent) attached. Use of a Customer 
Number is required. 



2. For printing on the patent front page, list (1) the 
names of up to 3 registered patent attorneys or 
agents OR, alternatively, (2) the name of a single 
firm (having as a member a registered attorney or 
agent) and the names of up to 2 registered patent 
attorneys or agents. If no name is listed, no name 
will be printed. 



3. ASSIGNEE NAME AND RESIDENCE DATA TO BE PRINTED ON THE PATENT (print or type) 

PLEASE NOTE: Unless an assignee is identified below, no assignee data will appear on the patent. Inclusion of assignee data is only appropriate when an assignment has 
been previously submitted to the USPTO or is being submitted under separate cover. Completion of this form is NOT a substitute for filing an assignment. 



(A) NAME OF ASSIGNEE 



(B) RESIDENCE: (CITY and STATE OR COUNTRY) 



Please check the appropriate assignee category or categories (will not be printed on the patent); □ individual □ corporation or other private group entity □ governme nt 
4a. The following fee(s) are enclosed: 4b, Payment of Fee(s): 

□ Issue Fee □ A check in the amount of the fee(s) is enclosed. 

□ Publication Fee □ Payment by credit card. Form PTO-2038 is attached. 

□ Advance Order - # of Copies □ The Director is hereby authorized by charge the required fee(s), or credit any overpayment, to 

Deposit Account Number (enclose an extra copy of this form). 

Director for Patents is requested to apply the Issue Fee and Publication Fee (if any) or to re-apply any previously paid issue fee to the application identified above. 



(Authorized Signature) (Date) 



NOTE; The Issue Fee and Publication Fee (if required) will not be accepted from anyone 
other than the applicant; a registered attorney or agent; or the assignee or other party in 
interest as shown by the records of the United States Patent and Trademark Office. 

This collection of information is required by 37 CFR 1.311. The information is required to 
obtain or retain a benefit by the public which is to file (and by the USPTO to process) an 
application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is 
estimated to take 1 2 minutes to complete, including gathering, preparing, and submitting the 
completed application form to the USPTO. Time will vary depending upon the individual 
case. Any comments on the amount of time you require to complete this form and/or 
suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. 
Patent and Trademark Office, U.S. Department of Commerce, Alexandria, Virginia 
22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. 
SEND TO: Commissioner for Patents, Alexandria, Virginia 22313-1450. 

Under the Paperwork Reduction Act of 1995, no persons are required to respond to a 
collection of information unless it displays a valid OMB control number. 



TRANSMIT THIS FORM WITH FEE(S) 
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Determination of Patent Term Extension under 35 U.S.C. 154 (b) 

(application filed after June 7, 1995 but prior to May 29, 2000) 

The Patent Term Extension is 0 day(s). Any patent to issue from the above-identified application will include an 
indication of the 0 day extension on the front page. 

If a Continued Prosecution Application (CPA) was filed in the above-identified application, the filing date that 
determines Patent Term Extension is the filing date of the most recent CPA. 

Applicant will be able to obtain more detailed information by accessing the Patent Application Information Retrieval 
(PAIR) system (http://pair.uspto.gov). 

Any questions regarding the Patent Term Extension or Adjustment determination should be directed to the Office of 
Patent Legal Administration at (703) 305-1383. Questions relating to issue and publication fee payments should be 
directed to the Customer Service Center of the Office of Patent Publication at (703) 305-8283. 
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Notice of Fee Increase on October 1, 2003 

If a reply to a "Notice of Allowance and Fee(s) Due" is filed in the Office on or after October 1, 2003, then the 
amount due will be higher than that set forth in the "Notice of Allowance and Fee(s) Due" since there will be an 
increase in fees effective on October 1, 2003. See Revision of Patent Fees for Fiscal Year 2004 : Final Rule . 68 Fed. 
Reg. 41532, 41533, 41534 (July 14, 2003). 

The current fee schedule is accessible from (http://www.uspto.gov/main/howtofees.htm). 

If the fee paid is the amount shown on the "Notice of Allowance and Fee(s) Due" but not the correct amount in view 
of the fee increase, a "Notice of Pay Balance of Issue Fee" will be mailed to applicant. In order to avoid processing 
delays associated with mailing of a "Notice of Pay Balance of Issue Fee," if the response to the Notice of Allowance 
is to be filed on or after October 1, 2003 (or mailed with a certificate of mailing on or after October 1, 2003), the 
issue fee paid should be the fee that is required at the time the fee is paid. If the issue fee was previously paid, and the 
response to the "Notice of Allowance and Fee(s) Due" includes a request to apply a previously-paid issue fee to the 
issue fee now due, then the difference between the issue fee amount at the time the response is filed and the 
previously-paid issue fee should be paid. See Manual of Patent Examining Procedure . Section 1308.01 (Eighth 
Edition, August 2001). 

Effective October 1, 2003, 37 CFR 1.18 is amended by revising paragraphs (a) through (c) to read as set forth below. 
Section 1.18 Patent post allowance (including issue) fees, 
(a) Issue fee for issuing each original or reissue patent, 



except a design or plant patent: 

By a small entity (Sec. 1.27(a)) $665.00 

By other than a small entity $1,330.00 

(b) Issue fee for issuing a design patent: 

By a small entity (Sec. 1.27(a)) $240.00 

By other than a small entity $480.00 

(c) Issue fee for issuing a plant patent: 

By a small entity (Sec. 1.27(a)) $320.00 

By other than a small entity $640.00 



Questions relating to issue and publication fee payments should be directed to the Customer Service Center of the 
Office of Patent Publication at (703) 305-8283. 
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The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . [3 This communication is responsive to the response filled on July 30. 2003 . 

2. M The allowed ciaim(s) is/are 1-21. 27-29. 31-41 and 43-47 , 

3. |3 The drawings filed on 04 February 2000 are accepted by the Examiner. 

4. |3 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)E3 All b)DSome* c)QNone of the: 

1 • £3 Certified copies of the priority documents have been received. 

2. S Certified copies of the priority documents have been received in Application No. <£&&§§3£i-. 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

5. □ Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

(a) □ The translation of the foreign language provisional application has been received. 

6. □ Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements noted 
below. Failure to timely comply will result in ABANDONMENT of this application. THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

7. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 
INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

8. □ CORRECTED DRAWINGS must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No. . 

(b) □ including changes required by the proposed drawing correction filed , which has been approved by the Examiner. 

(c) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of Paper No. . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. 

9. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 
attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1D Notice of References Cited (PTO-892) 2Q Notice of Informal Patent Application (PTO-152) 

3D Notice of Draftperson's Patent Drawing Review (PTO-948) 4[&4nterview Summary (PTO-413), Paper No. /{ . 

5D Information Disclosure Statements (PTO-1449), Paper No. . Examiner's Amendment/Comment 

7Q Examiner's Comment Regarding Requirement for.Deposit » 8[3 Examiner's Statement of Reasons for Allowance 

of Biological Material M A f /V 9 ^ other 



PRIMARY EXAMINER 



U.S. Patent and Trademark Office 
PTOL-37 (Rev. 04-03 



Notice of Allowability 



Part of PapeWJo 
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EXAMINER'S AMENDMENT AND ALLOWANCE 

EXAMINER'S AMENDMENT 
1 . An examiner's amendment to the record appears below. Should the changes and/or 
additions be unacceptable to applicant, an amendment may be filed as provided by 37 CFR 
1 .3 12. To ensure consideration of such an amendment, it MUST be submitted no later than the 
payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview with 
Mr. Thomas Spinelli (Reg. No.: 39,533) on September 29, 2003, October 1, 2003, and on 
October 6, 2003. 



The application has been amended as follows: 



Please cancel the claims 22-26. 



On page 4 claim 5 line 4 please add ^including color or geometric characteristics 



as one image,-- lifter the word "markers/O^ 
j^c. On page 8 claim 12 line 6 please addljt inc hiding color or geometric 



characteristics as one image,-l ^fter the word "markers,"?^ 
£d. On page 12-13 claim 19 line 7 please addjjl including color or geometric 



characteristics as one image,--||a fter the word "markers,"7\ 

ad^- 



2. On page 14 claim 27 line 5 please 
'geometric characteristics." 



as one image,— after the words 
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\* f On page 20 claim 46 line 4 please add ^i ncluding color or geometric 

characteristics as one image,— |after the word "markers,"^ 



g. On page 20-21 claim 47 line 5 please add — as one image,— after the words 
"geometric characteristics." 

Allowable Subject Matter 

2. Claims 1-21, 27-29, 31-41 and 43-47 are allowed. 

3. Claims 1-21, 27-29, 31-41 and 43-47 have been re-numbered to claims 1-40. 

4. The following is an examiner's statement of reasons for allowance: The instant invention 
defines a three-dimensional position and orientation sensing apparatus, method, and an article of 
manufacturing comprising an image input means for inputting an image acquired by an image 
acquisition apparatus and showing at least three/four markers having color or geometric 
characteristics as one image, three-dimensional positional information of the markers with 
respect to an object to be measured being known in advance. The claimed invention 
distinguishes over the prior art to Leis, et al., among other things, by the manner in which an 
image showing at least three/four markers having color or geometric characteristics as one 
image . The claimed combination allows for markers to be identified by their color geometric 
characteristics, and from the position and each marker in an image that shows at least three/four 
markers, the position and orientation of each marker with respect to image acquisition, apparatus 
are calculated. 

Obtaining a three-dimensional position and orientation of an object is conventional. 
However, the prior art (Leis, et al. USPN 5,828,770) of record fails to teach an image showing at 
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Art Unit: 2621 

least three/four markers having color or geometric characteristics as one image. Leis, et al.'s 
invention requires two images (i.e., stereo imaging). These elements in combination with all of 
the other elements of the claims are not taught or fairly suggested in the prior art of record. It is 
for this reason and in combination with the other elements of the claims that the claims 1-21 and 
27-47 are allowable over the prior art to Leis, et al. 

Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 

4. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Shefali D Patel whose telephone number is 703-306-4182. The 
examiner can normally be reached on M-F 8:30am - 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Leo H Boudreau can be reached on 703-305-4706. The fax phone number for the 
organization where this application or proceeding is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-306-0377. 




Shefali D Patel 
Examiner 
Art Unit 2621 



October 6, 2003 




